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Abstract 



Let H = {V, E) be an r-uniform hypergraph with the vertex set V and the edge set E. 
For 1 < s < r/2, we define a weighted graph G^""^ on the vertex set (^) as follows. Every 
. pair of s-sets I and J is associated with a weight wl^I, J), which is the number of edges 

' in H passing through / and J if / n J = 0, and if 7 n J / 0. The s-th Laplacian of 

H is defined to be the normalized Laplacian of G'"'. The eigenvalues of are listed 
« — ; ■ as Ag*', Aj*\ . . . , A/^l in non-decreasing order. Let )S''\H) = max,^o{|l-A["^|}. The 

. _ \s) ^ 

parameters \'-"\H) and Aj°'(i/), which were introduced in our previous paper, have a 
number of connections to the mixing rate of high-ordered random walks, the generalized 
distances/diameters, and the edge expansions. 
' For < p < 1, let H^{n,p) be arandom r-uniform hypergraph over [n] := {1, 2, . . . , n}, 

^ I where each r-set of [n] has probability p to be an edge independently. For 1 < s < r/2, 

^ ■ p(l - p) > ^i^, and 1 - p > we prove that almost surely 



CO' \M(H'^(n.'n))<—^ + (:<. + n(^)).l- ?- 

o 



A^^'(f7'-(n,p))<^ + (3 + o(l)) 
n — s 

We also prove that the empirical distribution of the eigenvalues of C^"^ for H^{n,p) 
follows the Semicircle Law if p(l - p) > ^"f/Z" and 1 - p > ^J+t-i, . 

1 Introduction 

The spectrum of the adjacency matrix (and/or the Laplacian matrix) of a random graph 
was well-studied in the literature HHinillllllllllllllllTllISlllI]. Given a graph G, let 
fii{G) , . . . , iin{G) be the eigenvalues of the adjacency matrix of G in the non-decreasing 
order, and Ao(G),..., An_i(G) be the eigenvalues of (normalized) Laplacian matrix of G 
respectively. Let G{n,p) be the Edos-Renyi random graph model. Fiiredi and Komlos [2T| 
showed that if np(l— p) ^ log^ n then almost surely fin = {l+o{l))np and max{— /xi, < 
{2 + o{l)) np{l — p). The results are extended to sparse random graphs [T71[5S] and general 
random matrices [151 HI]- Alon, Krivelevich, and Vu [1] proved the concentration of the 
s-th largest eigenvalue of a random symmetric matrix with independent random entries of 
absolute value at most 1. Friedman (in a series of papers [HI [IHl 120]) proved that the 
second largest eigenvalue of random c?-regular graphs is almost surely (2 -|- o(l))Vrf — 1 for 
any d > A. Chung, Lu, and Vu studied the Laplacian eigenvalues of random graphs with 
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given expected degrees; their results were supplemented by Coja-Oghlan [131 HI] for much 
sparser random graphs. 

In this paper, we study the spectra of the Laplacians of random hypergraphs. Laplacians 
for regular hypergraphs were first introduced by Chung 5 using the homology approach. 
Rodriguez [28l [29] treated a hypergraph as a multi-edge graph and then defined its Laplacian 
to be the Laplacian of the corresponding multi-edge graph. Inspired by these work, we 
[26) introduced the generalized Laplacian eigenvalues of hypergraphs through high-ordered 
random walks. Let H = (V, E) be an r-uniform hypergraph on n vertices. We can associate 
r — 1 Laplacians (1 < s < r — 1) to -ff; roughly speaking, captures the incidence 
relations between s-sets and edges in H . Our definition of the Laplacian at the spacial case 
s = 1 is the same as the Laplacian considered by Rodriguez [28l [29] . The s-th Laplacian is 
loose if 1 < s < r/2, and is tight if r/2 < s < r — 1. Here we consider only the spectra of 
loose Laplacians. 

For 1 < s < r/2, we consider an auxiliary weighted graph G*^''^ defined as follows: the 
vertex set of G^^^ is (^) while the weight function W : (^) x (^) — > Z is defined as 

1^ otherwise. 

The s-th Laplacian of H, denoted by C'^'^\ is the normalized Laplacian of G'-"^. For any 
s-set S, let ds be the number of edges in H passing through S] the degree of S in G*^"' is 
{^~/^ds- Let D be the diagonal matrix of the degrees {ds} and W be the weight matrix 
{'w{S, T)}. Note that T :— C'^'^)D is the diagonal matrix of degrees in G^^^. We have 



^/_r-l/2^y-l/2^ (2) 



The eigenvalues of are listed as Ag*'', A$^* ^ in non-decreasing order. We 



have 

= A^'^ < A^^^ < • • • < aJ:?^_^ < 2. (3) 

The first non-trivial eigenvalue A^*"* > if and only if G*^*^ is connected. When this occurs, 
we say H is s-connected. The diameter of G^''^ is called the s-th diameter of H. The largest 
eigenvalue A^*'^ ^ is also denoted by Xm\x- The (Laplacian) spectral radius, denoted by A^''^ 

is the maximum of 1 — aJ^'' and Amaa; — 1. 

This definition differs slightly with the one in [21] , where the vertex set of the auxiliary 
graph (denoted by G^'') ) is the set of all distinct s-tuples instead. Note that G^"^ is the 
blow-up of G*-"-*. Their Laplacian spectra differ only by the multiplicity of I's. Therefore, two 
different definitions give the same values of A^*-*, Xmax, and A^*^. 

For different s, the following inequalities were proved in |26| . 

X['^>X'^^>...>\™; (4) 

< \(2) < < \(L'V2J) C^;^ 
^*inax — *max — ' • • — max ' \^ / 

The S-th Laplacian has a number of connections to the mixing rate of high-ordered random 
walks, the generalized distances/diameters, and the edge expansions. Here we list some 
applications, which are similar to results in [26], and results for graphs [4] [6], [7], [8], [9], I12j. 

Random s- Walks: The mixing rate of the random s-walk on H is at most A*^**^. 
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The s-Diameter: The s-diameter of H is at most 

log 



log 



mnic,^^v\ dg is the minimum degree among ah s-sets. 
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Edge expansion: For l<<<s<|,5c(j), and T C ( ^ ) , define 
r) = {F e ) : 35 e 5, 3T e T such that SnT = 

\EiS,T)\ 



i, and S'UTC f}, 



e(5,r) = 
e(5) 

e(r) 



^((r)>(T)) 



Then we have 



|e(5,r) - e(5)e(r)| < .J e{S)e{T)e{S)e{T). 



The proofs of these claims are very similar to those in [26 and are omitted here. 

Our first result is the eigenvalues of the s-th Laplacian of the complete r-uniform hyper- 
graph k;^. 

Theorem 1 Let be the complete r-uniform hypergraph on n vertices. For 1 < s < r/2, 
the eigenvalues of s-th Laplacian of are given by 



1 - 



with multiplicity 



n 

i - 1 



for < i < s. 



Here we point out an application of this theorem to the celebrated Erdos-Ko-Rado Theorem, 
which states "if the n > 2s, then the size of the maximum intersecting family of s-sets in [n] 
is at most ("Zi) •" (The theorem was originally proved by Erdos-Ko-Rado [16] for sufficiently 
large n; the simplest proof was due to Katona |24|.) Here we present a proof adapted from 
Calderbank-Frankl [2 , where they use the eigenvalues of Kneser graph instead. (The relation 
between C'^^^K^^) and the Laplacian of the Kneser graph is explained in section 2.) 

It sufHces to show for any intersecting family U of s-sets, \U\ < ("Zi)- Note that U is an 
independent set of G^'^\KI^). Restricting to C/, C''^'>{K^) becomes an identity matrix; whose 
eigenvalues are all equal to 1. By Cauchy's interlace theorem, we have 



a1/^ < 1 < a 



(6) 



for < fc < \U\ — 1. Let N'^ (or ) be the number of eigenvalues of /^'"^(X^) which is > 1 
(or < 1) respectively. Inequality © implies that \U\ < and \U\ < . By Theorem [TJ 



2i+l> 



and N 



\U\ < min{A^+,7V-} 



- _ Y-Ls/2J ( (nA 



We have 



j=0 



n — 1 
s - 1 
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For < p < 1, let H^{n,p) be a random r-uniform hypergraph over [n] = {1, 2, . . . , n}, 
where each r-set of [n] has probabihty p to be an edge independently. We can estimate the 
Laplacian spectrum of H^{n,p) using the Laplacian spectrum of if^ as follows. 

Theorem 2 Let H''{n,p) be a random r-uniform hypergraph. For 1 < s < r/2, ifp{l—p) ^ 
'°f„" anii 1 — p 3> t/ien almost surely the s-th spectral radius A*-*-* satisfies 



A(^) < + (3 + 0(1)) . / -i^. (7) 



Moreover, for 1 < k < (") — 1, almost surely we have 



\xi^\H^n,p))^X^^\K:)\ < (3 + 0(1)) /i^. (8) 

V {r-s)P 

Note that G{n,p) is a special case of H^{n,p) with r — 2. By choosing s = 1, Theorem[5] 
implies that 



A(G(n,p))<(3 + o(l))J-^^ forp(l-p)»i^. (9) 
y [n — l)p n 

Chung, Lu, and Vu's result [Tl]. when restricted to G{n,p), implies 

1 log'' n 

X{G{n,p)) < {4 + o{l))^ forl-e>p>-^. (10) 
Wnp n 



Inequality Q has a smaller constant and works for a larger range of p than inequality 

(TO. 

Fiiredi and Komlos [21' proved the empirical distribution of the eigenvalues of G{n,p) 
follows the Semicircle Law. Chung, Lu, and Vu (llj proved a similar result for the random 
graphs with given expected degrees. Here we prove a similar result for random hypergraphs. 

Theorem 3 For 1 < s < r/2, if p{l - _p) > ^"^J-J" and I - p :$> J°iJl2s , then almost 
surely the empirical distribution of eigenvalues of the s-th Laplacian of H^(n,p) follows the 
Semicircle Law centered at 1 and with radius (2 + o(l))y^ ^r-3^^if-s j~ ■ 

Remark 1 The proof of Theorem\^ actually implies the eigenvalues of C^^\H^' {n,p)) — 

/:(^)(i^;) foiio' 

Thus we have 



C^'^\KIi) follows the Semicircle Law centered at and with radius (2 + o{l)) . 





max \X^^\H^{n,p))-X^:\K:;)\ > ( + o(l) | J^^. (11) 

i<fc<(;)-i 

This shows that the upper bound of \x["\H'-{n,p)) - xi'\K^)\ in Theorem\Eis best up to a 
constant multiplicative factor. 

The rest of the paper is organized as follows. In section 2, we introduce the notation and 
prove some basic lemmas. We will prove Theorem 1 in section 3 and Theorem 2 in section 4. 
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2 Notation and Lemmas 



2.1 Laplacian eigenvalues of hypergraphs 

Let H = {V,E) be an r-uniform hypergraph. For any subset S {\S\ < r), the degree of S, 
denoted by ds, is the number of edges passing through S. For each 1 < s < r/2, we associate 
a weighted graph G^*-* on the vertex set (^) to H as foUows. Every pair of s-sets S and T is 
associated with a weight ^(5*, T), which is given by 



w{S,T) 



dsuT ii S nT — 
otherwise . 



The s-th Laplacian of H is defined to be the normalized Laplacian of G^'*^ The degree 
of S in G(^) is J^j, wis, T) = C:/)ds. 

We assume that the s-sets in (^) are ordered alphabetically. Let N := ("); all square 
matrices considered in the paper have the dimension N x N and all vectors have dimension 
N. Let W := {W{S,T)) be the weight matrix, D be the diagonal matrix with diagonal 
entries D{S, S) = ds, d be the column vector with entries ds at position S G (g), J be the 
square matrix of all I's, and 1 be the column vector of all I's. Let T := (^~^)D; here T is 
the diagonal matrix of degrees in G("). Then, we have 

£(s) ^ J _ ^-1/2^2^- 1/2 _ 

We list the eigenvalues of as 



We aim to compute the spectral radius A''*'(i/) = max^^o |1 - XY'\. Let vo\^'>iH) := 
^„ /VN dg and cpo ■= ^ D^^^l. Note that 00 is the unit eigenvector corresponding to 

the trivial eigenvalue of £'-'*^. 

We are ready to prove theorem [T] 

Proof of Theorem [1) We can express C'-^^K^) using the following notation. The 
Kneser graph K{n, s) is a graph over the vertex set ('"') ; two s-sets S and T form an edge of 
K{n, s) if and only if S OT ~ 0. Let K be the adjacency matrix of K{n, s); the eigenvalues of 
K are with muhiplicity (") - (."J for < i < s (see l22j). Note that K{n,s) 

is a regular graph; so the Laplacian eigenvalues can be determined from the eigenvalues of 
its adjacency matrix. We observe that the associated weighted graph G'^-* for the complete 
r-uniform hypergraph is essentially the Kneser graph with each edge associated with a 
weight ("~2s)' -Note that the multiplicative factor {"Z2I) is canceled after normalization. 
The L'-'^^ (for K^^) is exactly the Laplacian of Kneser graph. Hence, 

^'^'KK) = I - 

Thus, the eigenvalues of s-th Laplacian of are given by 

(— 1)^ ("^*~*-') ff^\ f ^ \ 

^ with multiplicity ( . ) ^ ( . ) for < i < s. 

□ 



rr) y^J v-i 
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Remark 2 For 1 < s < r/2, we have 



MiL(f-z) = 1 + —. (13) 

n — s 

X^^HK) = (14) 



2.2 Random hypergraphs 

Let H^{n,p) be a random r- uniform hypergraph over the vertex set V = [n] and each r-set 
has probabihty p to be an edge independently. We would like to bound the spectral radius 
of the s-th Laplacian of H^'{n,p) for 1 < s < r/2. 

For any F G (^), let Xp be the random indicator variable for F being an edge in H^{n,p); 
all Xp^s are independent to each other. For any S,T € (^), we have 



W{S,T) 

Thus, 




Xf if n T = 
otherwise. 



E{W{S, T)) = ( if ^ n T - 0; 

^ ^ ' \ otherwise. ^ ^ 

The degree ds = J2scFe{l) ^p'^ ^^'^^ E(ds) = C-l)P- simplicity, let d ("Z^)p. 
We use the following Lemma to compare the eigenvalues of two matrices. 

Lemma 1 Given any two {N x N)-Hermitian matrices A and B, for 1 < fc < N , let fik{A) 
(or ^k{B)) be the k-th eigenvalues of A (or B) in the increasing order. We have 

\t,kiA)-pkm<\\A-B\\. 

Proof: By the Min-Max Theorem (see [H]), we have 

Uk(A) — min max x'Ax, 

Sk x€Sk,\\x\\ = l 

Uk(B) — min max x'Bx. 

Sk xeSk,\\x\\=i 

where the minimum is taken over all fc-th dimensional subspace Sk C M^. We have 
fJ-kiA) = min max x'Ax 

Sk x£Sk,\\x\\ = i 

= min max {x' Bx + x' [A — B)x) 

Sk x£Sk,\\x\\ = l 

< min max {x' Bx + \\A - B\\) 

Sk x£Sk,\\x\\ = i 

= ^ik{B) + \\A-B\\. 

Similarly, we can show ^k{A) > fJ,k{B) — \\A — B\\. The proof of the Lemma is finished. □ 
Our idea is to bound the spectral norm of the difference oi £'^''\H'-{n,p)) and r^^H-K'™)- 
Let M C^'\k;J ~ C^'\H''\n,p)) = T^^/'^WT-^''^ - J^^' '^"^^ M = Mi + M2 + 
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Ms + M4, where 



Ml 



rr) 



= -^^(PF-E(iy)), 



M3 



(T) ^ ^ C) ("D O ' 

J). 



By the triangular inequaUty of matrix norms, we have 

||M||<||Mi|| + ||M2|| + ||M3|| + ||M4||. 

Through this paper, the norm of any square matrix is the spectral norm. We would like to 
bound ||A/i|| for i = 1,2,3,4. We use the following ChernofF inequality. 

Theorem 4 Let Xi, . . . , Xn be independent random variables with 

Pt{X, = 1)=p, Pr(X, = 0) = 1 - p. 

We consider the sum X = X]"=i -^i' with expectation E(X) = np. Then we have 
(Lower tail) Pr(X < E(X) - A) < e^^'/^^W, 

(Upper tail) Pr(X > E(X) + A) < ^TEpnTW . 

Lemma 2 Suppose d > logN. With probability at least 1 — we have ds {d — 
SVdlogiV, d + 3^A^og77) for all S e 

Proof: Note dg = J2f-scf -^f ^^'^ ^{ds) = d. Applying the lower tail of ChernofF's 
inequality with A ^ 3^E(X)logA^, we have 

Pr(X-E(X)<-A)<e-^V2Em<^. 



Applying the upper tail of Chernoff's inequality with A = 3^E(Ar) logiV, we have 

1 



Pr {X - E(X) > A) < e ^mm+mj < 



jV27/8 • 



The probability that ds ^ {d—3y/d\og N, d+3y/d log A^) is at most Thus, with probability 
at least 1 - we have ds e{d- 3y/ d\ogN, d + 3y/d\ogN) for aU 5 G (^) . □ 
For convenience, let dmin '■= d — 3^/d\ogN , d^ax ■— d + 3\/d\og N ; almost surely we have 
<ds< for all S. 

Lemma 3Ifd> \ogN, then almost surely WM^W = O (^^^^) • 



Proof: Note E(iy) = (" ^s)?-^; where K is the adjacency matrix of the Kneser graph 

4j J. We can rewrite M3 as 

M3 = dD^^/^MoD^^/^ - Mq. 



K{n, s). Let Mq := ^n-s-^ K — '^J- We can rewrite M3 as 
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Note ||Mo|| = X^'HK^) = We have 



I Ma 



Mo 



< ||(d£)-V2 _ rfV2j)MoD-i/2|| + \\Mo{d^/^D-^/^ - 7)11 

< ||(dV2/ _ rf£)-V2)||||Mo||||£)-i/2|| + ||Mo||||(rfi/2£»-V2 - /)|| 



< 



O 



d I dd^^l^ 



"''M-l I'M 



d ^ d^j^ 1 



iVd 



□ 



Lemma 4 — p) ^ ^^^'^ almost surely 



^ (ds-df = (1 + 0(1)) Md(l-p). 

56(r) 



Proof: For SeQ, let Xs = {ds - df . We have 



E(Xs) = E((ds - d)2) = Var(ds) 



p(l-p) = d(l-p). 



We use the second moment method to prove that Xs concentrates around its expectation 
(")rf(l — p). For any S,T G (^), the covariance can be calculated as follows. 

Coy{Xs,Xt) = E{XsXt)-E{Xs)E{Xt) 

= E{{ds-df{dT-df)-d^l-pf. 

For F G (^), let Yp = Xp - E{Xf). Then we have ds-d = J2scf ^f- 
E{{ds - df{dT - df) = E{Yp,Yp,Yf,Yp,). 

F3,Fi: TcFsHFi 

Since E{Yp. ) = 0, the non-zero terms occur only if 

1. ^1=^2=^3=^4. In this case, we have 

EiYp.Yp.YF.Yp,) = E(r^J = (l-pfp+{-p)\l-p)=p{l-p)(l - 3p + 3p2). 

The number of choices is ("Z|'s'uj'|') • 

2. Fi = F2 ^ Fs = F4. In this case, wc have 

E{Yp,Yp,Yp,Yp,) = E(y|jE(r^J = p\l - pf . 

The number of choices is (,"_7||) (,"_7^|) - C-\^t\)- 

3. i^i = F3 ^ F2 = -Fk- In this case, we have 

E{Yp,Yp,Yp,Yp:) = E(Y|jE(y|j = p\\ - pf. 



The number of choices is (".jfu^j) 



(n-\SuT\\ 
\r-\SUT\} 



4. Fi = F4 F2 = Fs. This is the same as item 3. 
Thus, we have 

E{XsXt) = ("Z|5u^|)m1-p)(1-3p + 3/) 



n-sV fn-\SUT\Y fn-\SUT\\\ ^ ^ 
n-\SUT\\ 2^ ((^-^V ( n - \S T\V\ ^ ^ 



This expression on the right depends only on the size of SUT. Putting together, we get 
Var ^ = J2 Goy{X s,Xt) 

= {msXT)-d\i-pf) 

s,Te(Y) 



= E E f(":;V-i')(i-ei'+ei'')+2C:()V(i-p) 

i=s \SUT\=i \ ^ ^ ^ ^ 

^ E E (;::W-p)(i-6^'+6p^+2(;:;>(i-P)) 



=s |SUT|=i 
2s 



-j— « I Cl IT" I — ™' ^ 



=s |SUT|=i 

2« 



n 



rj (i-s)!2(2s-i)!(r-i)! 



= 0[r]d'il-pr 



Let X = ^s- Wc have E[X] = (^)d(l-p) and Var(X) = O - p)^). Applying 

Chebyshev's inequality to X = J2se{^)' have 



Pr (\X - E{X)\ > \ogn^/Va.Y{X)) < 



log n 

Thus, almost surely X = E{X) + 0{logn^yVa.T{X)) = (1 + o(l))(^)rf(l - p). □ 

Lemma 5 - p) > i/ien a/mosi sure/?/ ||M4|| < (1 + oil))^^^. 
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Proof: We can rewrite M4 as 

M4 = -L(dD-'/^JD-'/^-J) 



Here a := d'^/'^D'^^^l - 1. Note that the spectral norm of a vector is the same as the 
L2-norm. We have 



-1/2 



1 11 



Vd 



< 



ids - dY 

Ese(Y)('^s - dY 

mm rain } 



In the last step, we applied Lemma U Therefore, we have 



IIM4II 



Yl'D-^'^d^'^ 



lla'll 



< 



^\\a\\ (||l'7^-V2rfV2|| + ||i| 



< 




(1 + «(!)) 



1-p 



c;)v.-'"iv^<--'(i/(;: 



3 Proof of Theorem [2] 

To estimate the spectral norm of Mi and M2, we need consider the matrix C :=W — E(Vl^). 
We estimate the expectation of the trace of C* as follows. 
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Lemma 6 For any k satisfying k <^ \J "^(1 — p), we have 



s+k{r-s) (r-s\k 



E(Trace(C--)) ^ ^ |^ (, ^ ,)(,,)...(;/^),). , jp^l ^ J ■ (17) 
If further k = o (log(n''~*p(l — p))) , then we have 

s+k(r-s) /Oh\ 

The proof of this technical Lemma is quite long. We will delay its proof until the end of this 
section. 

Lemma 7 Ifp{l-p) > then we have \\C\\ < {2{''^/) + o(l)) ^d{l - p) almost surely. 



Proof: By LemmaEl we have E(Trace(C2'=)) < (1 + o(l)) )/(l -p)^ 

As EdICffe) < E(Trace(C2'=)), we have 

E(iicii^>) < (1 + 0(1)) (, ^:;;;;';:;('(;:'',.),,. (i^)p-(i - 

s + fc(r — s) /r— 

Let [/ := (fc+")(,,);.+i((/_2s)!)'' P'' (1 -P)''- By Markov's inequality, 

Pr(||C^|| > + W) = Pr(||C||''= > (l + e)2'^C/) 

< 



(H 




(H 


ho(l))C/ 


(1- 




1 + 


0(1) 


(H 


h e)2'= ■ 



Let g{n) be a slowly growing function such that g{n) — )■ 00 as n approaches the infinity 
and g{n) <^ — — fYSin^^~~- "^^^^ is possible because n^^''p{l — p) ;» log^ n. Choose k = 
sg{n)logn and e — l/g{n). We have k <C (n'"~*p(l — p))^/** and e — >■ 0. Then we have 
(1 + o(l))/(l + e)"^^ = 0(n^^), which implies that almost surely 



IIICII < (l + o(l))Vt/ 



< 7121-2 

^ ^2 



Xi-p) 



s!(r-2s)! 



+ 0(1)) 



□ 

Recall M2 = TT^C'. We have 
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Lemma 8 If p{l - p) > ^ff^, then we have \\M2\\ < (2 + o{l))J^ almost surely. 



Lemma 9 If p{l - p) > ^ff^, then we have \\Mi\\ = O ^ V(i p)i°g^ J almost surely. 

Proof: We have 

Ml ^ -J— (d-^/'^CD-^/^ - d-^C 



= J— ((Z?-l/2 - d-l/2/)Ci?-l/2 + ^-1/2^(^-1/2 _ rf-l/2j)^ 
\ s / 

Note ||D-l/2_d-l/2/|| < |d-;/2_^-l/2| ^ 0( VSZ), ||^-l/2|, < ^ (l+o(l))d-l/2, 



and ||C|| = (2('';'^) +o(l)) ^d(l-p). We have 
1 



Ml = 



- d-l/2j)C^-l/2 + d-l/2c(i^-l/2 _ rf-l/2j) 



V(l-P) logiV 



□ 



Proof of Theorem [2} Combining Lemmas [H [3 [3 and [9l we have 

||M|| = ||Mi + M2 + Af3 + M4|l 

< ||Mi|| + ||Af2|| + p/3|| + ||Af4|| 



= (3 + 0(1)) ^ 



In the last step, we use the fact = o [y^j since 1 - p > i^sii. 

By Lemma [l] for 1 < fc < (") — 1, we have 



\xi'\H^r^,p))^\i^\K:j\ < ||M|| < (3 + o(l))y^ 



1-p 



□ 

Reall that is the random indicator variable for F being an edge in II'^{n,p). For any 
fixed positive integer t, the terms in Trace(C*) are of the form 

CS1S2CS2S3 ■ • -CStSsi- 

Here cst = W{S,T) ~E{W{S,T)) = J2 Fe{^) (Xf-HXf)) USHT^ 0; cst = otherwise. 

SUTCF 

Note cSiSj = if 5,; O Sj 7^ 0. Thus we need only to consider the sequence S1S2 . . ■ St Si 
such that Si D Si+i = for each 1 < i < t, here t + 1 = 1. 
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, we define a random variable cfj. as follows. 

_ r Xf- E(Xir) if 5 n T = and 5 U T C F; 
^•^^ \ otherwise. 

The sequence w := S1F1S2F2S3 . . . St Ft Si is called a closed s-walk of length t if 

1. Su...,SteO, 

2. i^i,...,FieQ, 

3. SiDSi+i = 0, for z = l,2,...,t, 

4. C F,, for i = l,2,...,t 

Here we use the convention 5*4+1 = 5*1. Those r-sets F^'s are referred as edges while those 
s-sets S'i's are referred as stops. For 1 < i < t, we say w walks from Si to Si+i at step i via 
the edge Fi. 

Using the notation above, we rewrite the trace as 

Trace(C*) = ^ '^sls2^sls3 ■ ■ ■ '^slsi' 
closed s-walks 

where the summation is over all possible closed s-walks of length t. 
Taking the expectation on both sides, we get 

E(Trace(C*)) = ^ ^i^ls^^ls. ■ ■ ■ ^gsj- 
closed s-walks 

The terms in the product above can be regrouped according to the values of Fj's; those 
terms with distinct F's are independent to each other. Since E{cg j,) = 0, the contribution 
of a closed walk is if some F appears only once. Thus we need only to consider the set 
of closed walks where each edge appears at least twice or do not occur; we call these closed 
walks as good closed walks. A good closed walk can contain at most [|J distinct edges. 

Let Gi be the set of good closed walks of length t with i distinct edges. For 1 < i < [|J , 
let be the set of good closed walks with exactly i distinct edges and j distinct vertices; we 
have ft :=Uj^?- . 

We consider a good closed walk in ft. When a new edge comes in the walk, it can bring in 
at most (r — s) new vertices. Thus such a good closed walk covers at most rrii := s + i{r — s) 
vertices. Any walk contains at least one edge. Hence, the number of vertices in a walk from 
ft is in the interval [r, m,]. 

We have 

LIJ 

E(Trace(C*)) = ^ ^ H^ls^^ls. ■ ■ ■ ^Is.)- (19) 
i=i SiFiS2...StSieai 

Assume that an edge F occurs q times in a good closed walk and T := {i : 1 < i < 

t and Fi = F}. We have Pr (Ui^Tcls.+i = (1 -p)") = P and Pr (n^eTcf^s.+i = (-P)") = 
1 — p. Thus, for each positive integer Z > 2, we have 

E (n,eT4,s.+,) = (1 - P^P + (-p)'(i -p)< p(i - P)- 

The equality holds for g = 2. 
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Pick a good closed walk w := S1F1S2F2S3 ■ ■ ■ StFtSi in G,. Let F\ . . . , be the list of 
distinct edges in the order as they appear in w. 

For each 1 < ^ < let T; := {1 < j < < : Fj = F'}; then X^Li l^'l = We have 

This implies 

E E(4j5^cg53 . ..c^slsj < -P)^ (20) 



for all 1 < i < [|J. In particular, the equality holds when t — 2i. Combining equation (IT9|) 
and inequality (|?0|) . we get 

E(Trace(C*)) <^|g.|p^(l-p)\ (21) 

i=l 

Now we estimate the value of \Gi\, the number of good closed walks of length t on i edges 
and j vertices. Let w be a good closed walk in Gf- For 2 < A: < j, let • • • SF'^S' ■ ■ ■ be a piece 
of sequence in w where the edge F^ occurs first time; S is called the in-stop of F'^ and S" is 
called the out-stop of F^. 

The following lemma will state the hypergraph structure of these i edges; it is independent 
of the walk w. We will use the following notation. Let S = U]^-^ ) . For any s-set S G 
the degree of S, denoted by ds, is the number of edges in {F^, F^, . . . , F*} containing S. 

Define 

^, _ ( ds — 1 if there exists a unique k such that S — Fk H (uj^^j^F;), 
^ \ ds otherwise. 

Lemma 10 Assume that F^, . . . ,F' is the list of distinct edges in the order as they appear 
in w G Gf ■ Then we have 

E(4-i)< (i + ^(/,))k-j-)- 

S G*S 

Proof: For 2 < fc < let Xk = \F'' \ {u'[^l F'-)\; we have 

< Xk < r ~ s. 

Thus, 

j — r + X2+X3 + -- -+Xi<r + {i — l)(r ~ s) — m^. 
Since a new edge Fk can contribute at most ('^ to J^sesi^s — 1), we have 



ses fc=2 



r-Xk 
s 



Let K :^ {k: Xk = r-s,2 < k < i} a.nd K ^ {2, . . . , i}\K. The edges in the set {Fk: k £ K} 
are called forward edges while the edges in the set {Fk : k G K} are called backward edges. 
Note each backward edge contribute at least one to mi — j; thus 

m,-j> \K\. 
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Note for each kGK, (''"j"') = 1. We have 



SeS k=2 

V - Xk 



1^1 + E t 
1^1 + E 



_ s 

r - Xk - s + \ fr ~ Xk 
1 



< 



2 

_ s Vs 

For any k £ K, let ^(Fft) := Fk n (ufrj^F;) be the starting stop of Fk when Fk first 
occurs in w. List the elements in if as fci, ^2, • ■ • , in an increasing order. Consider the 
sequence of stops S{Fk-^), S^Fk^), ■ • • , S{Fk^,^^ ) (not necessarily distinct). Let z be the number 
of distinct stops in the sequence. If S{Fki) does not appear the first time in the sequence 
above, then we consider the partial walk Sk,_^Fki_^ . . . Sk,Fk,. Since Fki_^ is a forward edge, 
there exists at least one backward edge for some I' G {ki-i,ki). Thus, 

\K\ < z + \K\ < z + rrii - j. 

Hence, 

< \K\ + l^/_;)im.-j)-z 

The proof of this Lemma is finished. □ 
Lemma 11 For 1 < i < [|J and r < j < rrii, we have 



yt-2ij i + s J {siy+^ {{r - 2sy.y 

Here C\ and C2 depend only on r and s, independent of i, j, and n. 
Corollary 1 For 1 < i < [|J and n i^^, we have 



t-2 \ 1 /2A fr-sV ' n" 
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Proof: We can associate a walk w £ Qf with a code of length t consisting of three symbols: 
'(', ')', and We scan the edges of the walk w from left to right; if an edge appears first 
time, then we assign the code '('; if an edge appears second time, then we assign the code ')'; 
otherwise, we assign the code 

For example, consider the following good walk with z = 3, j = 8, and t = 8: 

w = SiFiS2F2SsF^S4FiS5FiS4F^SsF2S2FiSi 

Here edges are: Fi = (1,2,3,4,5), F2 = (4,5,6,7,8), F^ = (7,8,5,3,4). Stops are: Si = 
(1,2), ^2 = (4,5), S3 = (7,8), ^4 = (3,, 4), S5 = (2,5). The code for this walk is ((()*))*. 

Since w has i distinct edges, there are i '('s, i ')'s, and {t — 2i) '*'s. Note that the number 
of '(' is always greater than or equal to the number of ')' at any point when the sequence is 
read from left to right; each '(' has a matched ')' in the sequence. The symbol starts at 
position three and up. There are QZ2i) ways to choose the '* '-positions and ^(^') ways to 
choose i matched parentheses (the Catalan number). The number of such codes is 

t-2\ 1 f2i 



t-2iji + l\ i 

To construct a walk from a given code, wc scan the symbols from left to right. The first 
symbol is always '('. There are (^) ways to choose the first stop and ("Zg) ways to choose 
the rest of vertices in the first edge F^. Suppose that we already build a partial walk and 
need to decide the next stop and the next ciclge. There are at most ('^7*) ways to choose the 
next stop S. The choices of selecting the next edge depends on the next available symbol in 
the code sequence. Let 6(, 6), and 6* be the product of the number of ways to choose the 
next edge at the '(', ')', and positions respectively. We have 

i«'i^(;:.-)f:^e;)(:)Cr)''<-'-" 

First we estimate 6(, the number of ways to choose new edges F^, . . . , F' given the first 
stop Si. Besides the s vertices selected at the first stop, there are ("Z^) ways to choose 
remaining j — s vertices. Recall that F^, . . . , F* is the list of distinct edges in the order as 
they appear in w. For 2 < I < i, let F' := F' \ (ujziiF''), xi := |F'|, and yi := r - s - xi. We 
also define F^ := F^ \S'i; xi := \F^ \ = r — s, and yi = 0. Note that U^^^F' forms a partition 
of the remaining (j — s) selected vertices. The number of ways to choose such a partition is 



Xl\X2^- ■■■Xi\ 



To choose F; , wc need select xi new vertices and yi old vertices; each old vertex has at most 
j choices. We have 



Observe that ^21^2 Vi = '>^i~ j ^^'^ 



n — s\ {j — s)l 



j — s J {r — s)\x2\ ■ 



(j - s)! ^ ^ *^ ("^» ~ 



{r — 8)1x2^ ■ ■ ■ Xi\ \r — s J {{r — s)\y~^ 
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The number of ways to choose X2, ■ ■ ■ , Xi is the same as the number of ways to choose y2, ■ ■ ■ ,yi, 
which is {"''~'.'^'r^) < {mi -j + i- 2)"' "J. Therefore, 



h < E 



X2,...,Xi 



j ^ s J (r — 5)1x2! • • • Xj! 



n — s \ ( J — s 



^ O-^Jlr-Jcra^l^^J ■ '''' 

There is at most i choices of edges at each position. Thus 

6* < (25) 

It remains to bound by We first present an easy bound for by Edge F can be chosen at 
most one ')'-position. For any possible stop S G S , S can appear at the )-positions at most 
ds times; each occurrence of S involves different edges since we are considering the second 
occurrence of edges. Thus, 

< n '^s- ^ n ^ i^'^^^"'-'^. 

ses ses 

We need a better upper bound for by Consider a stop S which is first chosen at a ')'- 
position. Let F be the edge on the walk right before the ') '-position; i.e., the walk w enters S 
through F. If this F occurred before, then the choices of edges at ') '-positions starting with 
S is at most 

{ds - 1)! < 1"^^-^ 

If this F occurs first time and F is an forward edge, then there is only one choice for the next 
edge leaving S; namely F itself. In this case, the choices of edges at ')'-positions starting 
with S is at most 

{ds - 1)! < 

In the remaining case, F must be a backward edge. The number of backward edges is at most 
rrii — j. Since F contains at most stops, the number of such S is at most (^) {rrii — j). A 

additional factor i is enough. We have 



S:ds>2 



S 

< i{:)i^i-i)ii^+-s{s-.))i^i-i) 
i 



(a)+i+fG:0)('"*-i). (26) 
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Combining equations ([24]), and ([26l), we get 



m < 



t — 2\ 1 / 2i\ fn\ fr — s\^fn — 



J - s 



t — 2i J i + 1 \ i J \s J \ s J \ j — s J \r — 
irn^-ry. f !^^i±l^y^'"'"'\.t-2..((';)+i+|(,:,))(™.-j) 



t-2ij i + s J (s!)»+i((r - 2s)!)* 



(j-r)! V 2 



i-2iy i + lVvV s / (s!)*+n(r - 2s)!) 



Here we set Ci = 4(r - s)^ and C2 = + 4 + | (^^ J . □ 
Lemma 12 If t = 2k is even, then we have 

' ' \mkj ik + l){s\)''+^iir-2sy.)''\k J' ^ ' 

Proof: We will construct a bijection from t?™*" to a triple {U,V,C), where U is & set of mfe 
vertices, 7^ is a partition of U into (fc+ 1) s-sets and k (r — 2s)-sets, and C is a code consisting 
of k pairs valid parentheses. 

For any good walk w £ let U be the set of vertices covered by w. Note each edge 

appears exactly twice. We define a graph T, whose vertices are the stops in w. Two stops 
are connected if they belong to one edge. Observe that T is acyclic and connected; T must 
be a tree. Since T has exactly k edges, T must have k+1 vertices. Hence w has exactly k+1 
stops; we list them as S*", S^, . . . , 5'^. For 1 < i < fc, let Ei be the set of (r — 2s) vertices in 
but not in any stops. We get a partition: U — (u^^qS'-') U (uj^iSj). A code consists of k '(' 
and k ')' is generated as follows. When we scan the walk from left to right, if an edge appears 
the first time, we append the code by a '('; otherwise, we append the code by a ')'. The code 
is a valid sequence of k pairs of parentheses. (In this case, the number of '*'s is zero.) It 
suffices to recover a walk from a partition of [nik] and a sequence of valid parentheses. 

Given a partition of U 

(uUoS^) U (U)^,E,) 

and a sequence of k pairs valid parentheses, we first build a rooted tree T as follows. At each 
time, we maintain a tree T, a current stop S, a set of unused stops S. Initially T contains 
nothing but the root stop Sq, S := Sq, and S = {Si, S2, ■ ■ ■ , Sk}- At each time, read a symbol 
from the sequence. If the symbol is an open parenthesis, then find an Si in S with index i as 
small as possible, delete Si from S, attach Si to T as a child stop of S, and let S := Si; if the 
symbol is ")" , then let S point to the the parent stop of the current S. Repeat this process 
until all symbols from the sequence are processed. 

Since every closed parenthesis has a matching open parenthesis, this process never get 
stuck. When the process ends, a rooted tree T on the vertex set {Sq, . . . , Sk} is created. For 
1 < i < k, let Fi be the union of Ei and two ends of i-th edge, which created in the process. 
For example, for A; = 3, if the sequence is (())(), then the corresponding good closed walk is 

S1F1S2F2S3F2S2F1S1F3S4F3S1 
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where Fi = SiU S2U Ei, F2 = S2U S3U E2, and F3 = S'4 U S'l U E3. 

Thus, this is a bijection from to all triples {U, V, C}. The number of ways to choose 
rrife vertices is {^J- The number of ways to choose these sets So, Si, . . . , Sk, Ei, . . . , Ek as a 
partition of U is 

ijik \ mk\ 



s,...,s,r -2s,...,r -2sJ (s!)'^+i ((r - 2s)!)'^ ' 

The number of sequences of k pairs valid parentheses is the Catalan number x^(^fc^)- 
taking product of these three numbers, we get equation (P7)) . □ 
Proof of Lemma [6} By equations 1^1^ and ([2^ . we have 

LIJ LIJ 
E(Trace(C*)) < ^ \g, \p\l - pf < (1 + o(l)) ^ a,. 

i=l i=l 

Here a. ^ rr)*-'(,pgi^. We get 

/'t-2\-t-2'i 1 (2i\(r-s\i—^ n'"ip'(l-p)' 
fli _ \t-2i)'- s I (s!)'+l((r--2^)!)' 

Oi+i ^ / t-2 1 <-2»+2Wr-^\*-'-l K"'' + ip'+i(l-p)' + i 

Vt-2j-2/' i+2W+lA s I (s!)»+^((r-2s)!)» + i 

i3(2i- l)(i + 2) {r-s)\ 

~ (2i + l){t - 2z)(t - 2i - 1) n'-^pil - p) 

3«4(r- s)! 
< — . 

n'^~^p{l — p) 

When n^^''p{l — p) ^ f^, we have = o(a,;+i). Thus, 

E(Trace(C*)) < {I + o{l))ayt_^. 

When t = 2k, we get 



s+kir-s)(r-s\l<^ /Ol,\ 



For t = 2fc + 1, we have 

E(Tracc(C2'=+i)) < (l + o(l))afc 

^ "+°"» (jr)(,.!r.(l-2.).)' fi>'"-^'^ 

Now we assume /c = o(log(n'"^''p(l — _p))). For t — 2k, let 
It is clear that E(Trace(C^'')) > bk- We also have 

fc— 1 nifc — 1 

E(Trace(C2'=)) - 6fc < ^ - p)' + ^ _ 
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We conclude 



Note flfc = (1 + o(l))('-7)^fe and a, = O (^Ofc ( „.-4(i-p) )' 

E(Trace(C2'=)) - 6. = O f 6 J" " ' V f ^^T^^ T + ^1 1 = o{hk). 



s J — p) n 

Here we use the fact {^-'f + j ^ ^(i) gj^ce fc = o(log(n'--^p(l - p))). □ 

4 The semicircle law 

Let us review the definition of the Semicircle Law. Let F{x) be the continuous distribution 
function with density f{x) such that f{x) — {2/tt)\/\ — when \x\ < 1 and f{x) — when 
\x\ > 1. Let A be a Hermitian matrix of dimension N x N. The empirical distribution of the 
eigenvalues of A is 

F{A,x) :— -^|{ eigenvalues of A less than a;}|. 

We say, the empirical distribution of the eigenvalues of A asymptotically follows the 
Semicircle Law centered at c with radius R if F{^{A — cl),x) tends to F{x) in probability 

as N goes to infinity. (In this case, we write F{^{A — cl),x) A F{x).) If c is the center of 
the Semicircle Law, then any c' = c + o(i?) is also the center of the Semicircle Law. 

Theorem 5 // n^^''p{l — p) ^ oo, then the empirical distribution of the eigenvalues of 
W — E{W) follows the semicircle law centered at with radius 2^ ('^7*) G-TlP^^ ~ ■ 



Proof: Let R 2^('^;^) - p), C := W^- E(14^), and Cnor ^C. 

To prove the theorem, we need to show that for any fixed i, the i-th moment of F{Cnor, x) 
(with n goes to infinity) is asymptotically equal to the t-th moment of F{x). We know the 
t-th moment of F{Cnor, x) equals (") E(Trace(C^o^)). For even t — 2k, the t-th moment of 
F{x) is (2fc)!/22'=fc!(fc + 1)!. For odd t, the t-th moment of F{x) is 0. 

In order to prove the theorem, we need to show for any fixed fc, 

^E(Trace(C^t)) = + ^^'^ k^kl 1)1 

and 

^E(Trace(C^^+i)) = o(l). 



We know 



E(Trace(CL.)) = -^E(Trace(C*)) 



for any t. By Lemma [51 we have 



s+k(r-s) /9k\ 

Em..ce(C»)) . (l + °a)) (,^i)(.y,.((,_,.),). (,)pM-rt'. 



Then 



E(Trace(C;^S.)) = (l + o(l)) 



Q) ' ' ' ' ''22'=fc!(fc + l)! 
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as desired. 

By Lemma [6] again, we have 

E(Trace(C2'^+i)) = O 

Thus 



(fc + l)(s!)'=+i((r--2s)!)'= \k 



^E(Trace(C-r )) = O 



(fc + l)i? 



o(l). 



Here fc is any constant but i? — > cxd. The theorem is proved. □ 
The foUowing Lemma is useful to derive the Semicircle Law from one matrix to the other. 



Lemma 13 Let A and B be two {N x N)-Hermitian matrices. Suppose that the empirical 
distribution of the eigenvalues of A follows the Semicircle Law centered at c with radius R. If 
either \\B\\ — o(i?) or the rank of B is o{N), then the empirical distribution of the eigenvalues 
of A + B also follows the Semicircle Law centered at c with radius R. 

Proof: It suffices to show F{j^{A + B ~ cl),x) A F{x). First we assume ||i?|| = o{R). By 
Lemma [U for 1 < fc < iV, we have 



Ilk ( -{A + B-cI) 1 -/ifc \-{A-cI) 



Hence 



F\ i(A-c/),a;- ^) < F ( ^A + B - cl),x\ < F (^{A- cl),x + 



R J \ / 

Since ||B|| = o{R), we have - c/), a: - ^) 4 F{x) and F (^j^{A - cl) , x + 

F{x). By the Squeeze theorem, we have F{-^{A + B — cl), x) A- F{x). 

Now we assume rank(i?) = o{N). Let U be the kernel of B (i.e. B\ij — 0); U has 
co-dimension rank(B). Let Z := -^{A — cl)\u = -^{A + B — cl)\u. By Cauchy's interlace 
theorem [53], for 1 < j < — rank(i?), we have 

^-^)) - (^) - /^i+rank(B) ^ ^J) 

H(^^{A + B-cr}^ < ^Ij {Z) < /i,+rank(i3) (J^{A + B - cl) 

Thus, for rank(_B) + 1 < j < — rank(i?), we have 

Mi-ra„k(B) (^-^(^ - C/)^ < Aij (^-^(^ + B- C/)^ < flj+r-^MB) {^^(^ " c/) ) . 

It implies 

F(^iA-cJ),x)-'-^<F(^iA + B-cI),x]<F(iiA-^clU^ ' ^^^^^^ 



R' " j N - \R' J ~ \R J N 

Since rank(B) = o{N), we have F {j^{A-cI),x) ± I2HM^ 4 F{x). By the Squeeze 
theorem, we have F{^{A + B ~ cl),x) A F{x). □ 
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Proof of Theorem [3l Recall 

C<-'^ (K) ~ (H'-{n,p)) = Ml + M2 + Ah + M4. 

We can write C^'^^H'' {n,p)) as -M2 + f 1 - j I + Bi - A'h - M4 - Afi, where Bi = 



By Theorem [5l the empirical distribution of the spectrum oi W — E(VF) follows the 
Semicircle Law centered at with radius (2 + o(l))y^ Cl") (r-s)p(-'- ~ -P)- Since = 

^j:^(VK - E(VF)), ^1 - I - M2 follows the Semicircle Law centered at c := 1 - 

with radius R := (2 + o(l)). I /r-X^S^ 7^- Note -^tttt- ~ oiR). We can change the center to 1. 

V ( . ){r^s)P (J 

By Theorem[Il C^'^K^^) has an eigenvalue 1 - (-l)''-^^ with muhiphcity ('^') - (^!^ J. 
Thus Bi has rank (^"1) = o (("))• We also observe that AI4 has rank at most 2, ||Afi|| = 

V(l-p)logjV^ _ , II A f II _ ^ N/BjlV 



O |^ V(i P)'°g^ j ^ g^j^d pj^ii ^ o (^^^^ j = o{R). Here we notice d > log^/^ n and 

By Lemma [131 the matrices Bi, Mi, M3, and M4 will not affect the Semicircle Law. The 
proof of this Lemma is finished. □ 
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